Classification of Feedback Expressions in Multimodal Data
نویسندگان
چکیده
This paper addresses the issue of how linguistic feedback expressions, prosody and head gestures, i.e. head movements and face expressions, relate to one another in a collection of eight video-recorded Danish map-task dialogues. The study shows that in these data, prosodic features and head gestures significantly improve automatic classification of dialogue act labels for linguistic expressions of feedback.
منابع مشابه
Multimodal Corpora : Advances in Capturing , Coding and Analyzing Multimodality 18 May 2010 PROCEEDINGS
This paper addresses the issue of how linguistic feedback expressions and head gestures relate to each other. The data are a collection of eight video-recorded Danish map-task dialogues annotated with phonetic and prosodic information. We focus on the analysis of the listeners’ head movements and face expressions and on how they relate to feedback expressions in their different prosodic realisa...
متن کاملMultimodal feedback expressions in Danish and Polish spontaneous conversations
This paper presents a pilot comparative study of feedback head movements and vocal expressions in Danish and Polish naturally occurring video recorded conversations. The conversations involve three well-acquainted participants who talk freely in their homes while eating and drinking. The analysis of the data indicates that the participants use the same types of head and spoken feedback in the t...
متن کاملThe Impact of Multimodal Channels on Teaching Idiomatic Expressions to Intermediate EFL Learners with Regard to Their Attitudes
This study was to explore facilitative function of using multimodal channels over single channel presentation and comprehension of idiomatic expressions to Iranian EFL intermediate proficiency learners. Out of a pool of 90, sixty intermediate participants were homogenized by a QPT test, using a quasi-experimental design. They were randomly assigned to three equal groups: WhatsApp-, SMS- and Cla...
متن کاملCreating Comparable Multimodal Corpora for Nordic Languages
This paper describes the collection and annotation of comparable multimodal corpora for Nordic languages in a project involving research groups from Denmark, Estonia, Finland and Sweden. The goal of the project is to provide annotated multimodal resources to study communicative phenomena, such as feedback, turn-taking and sequencing in the languages involved in the project and to compare these ...
متن کاملMultimodal Behaviour and Feedback in Different Types of Interaction
In this article, we compare feedback-related multimodal behaviours in two different types of interactions: first encounters between two participants who do not know each in advance, and naturally-occurring conversations between two and three participants recorded at their homes. All participants are Danish native speakers. The interactions are transcribed using the same methodology, and the mul...
متن کامل